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ABSTRACT 



Recent vcrA with Automatic Speech Recognition has 
focusea on applications and productivity considerations in 
the man-machine interface. This thesis is an attempt to see 
if placing users cf such, equipment under time-induced stress 
nas an effect on their percentage correct recognition rates. 
Suojects were given a message-handl mg taslt of fixed length 
and allowed progressively shorter times to attempt to 
complete it. Questionnaire responses indicate stress levels 
increased with decreased time-allowance; recognition rates 
decreased as time was reduced. 
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I. INTRODUCTION 



Stress has long been an intensely active area of 
investigation. Pore recently, the intersection of physiology 
and psychology has concerned itself with the influence of 
cognitive and errotive factors on quantifiable variables in 
the hurran organism's equation. This research has turned from 
the most fundamental indices of human reaction (cardiac 
rate, electrogal vanic response) to more subtle measures such 
as various features of the human voice. 

Stress, however defined, has clear and important 
implications for the conduct of military operations. In the 
warfare environment, one encounters some of the few factors 
universally acknowledged to cause psychological stress: it 
is one of the few areas where one knows apriori that life- 
threatening situations are consistently found. Thus the 
psycho-physiological correlates cf military action have 
furnished both an area of inquiry and the raw data for those 
interested in the study of the human under stress. Swedish 
researchers took an early lead in the investigation of 
stress in the military environment. [Ref.l] 

The investigation of any phenomenon requires first and 
foremost a statement delimiting the area cf research. Stress 
has yet to receive a widely accepted definition. Stress 



y 



^T C *R£Y 




research tends to divide intc two camps: these interested in 
physiological stress and those pursuing the psychological 
variety. Both claim the territcrity of psychophysiology. 
Eeycnd this, the definition of stress breaks down, in the 
main, into an examination of either a stimulus or a 
response: there appears to be no common ground. Cne thing 
which emerges clearly from published research in the area is 
that a synthetic conception of stress is in order, one bread 
enough to cover the wide (and widening) area of inquiry 
already embarked upon, and which would permit breakdown into 
narrower, more specialized areas of interest. 

Given the vagaries of the published resources currently 
available, it is necessary within the context of the present 



paper to 


work 


within 


an operational ly- 


defined , 


problem- 


oriented 


view 


of stres 


s. From 


a military 


commander's point 


of view, 


an 


area of 


grea t 


potential 


interest 


is the 



interaction of stress with voice-input to computer systems. 
As miniaturization and expanding technology have made 
computers a more widespread phenomenon in the military 
environment, the limiting factor (in the military just as 
with civilian applications) continues to be the human 
interface with the ever- expanding base of information and 
decision aids available. Voice-input to computers provides 
the field user with a higher-order interface, at a level 
above even user-friendly query languages. This type of 
interface has the potential to facilitate the user's ability 

10 



nVRE- 




to access and manipulate the vast resources new Decerning 
available to him: it is the next logical step in the 
evolution of man-machine compatabi li ty . Computers are now 
able to handle problems which not long ago would have 
absorbed an enormous amount of man-hours, but the man is 
still "in the loop”. 

...though we hail the advent of the postindustrial 
society, in which substantially ail our essential human 
needs will be produced without a great amount of human 
effort, the fact remains that the millenium is net here 
yet. Human beings are not yet obsolescent as important 
contributors to the productive process.' The quality of 
performance cy men and women, whether in manufacturing 
or servicing, still accounts for a very large part in 
the variation in productivity, however one chooses to 
define the criteria of productivity - and this condition 
will continue to prevail far into the future. [Ref. 2: 
p. XIII] 



Automatic Speech Recognition (ASR) is a demonstrated, 
on-line technology of clear interest to the military 
commander. (For a discussion of the range of voice input 
appl ica tions , the reader is referred to References [2] and 
[4] ) The rapidity with which current data processing and 
computer networks now operate necessarily imply that the 
machinery spends an inordinate part of its time waiting for 
input from the human operator. Speeding up this aspect of 
the interface, a quantum leap in user-accomodation, is one 
of the major contributions to be expected (and even new 
available) from speech recognizers linking the human to the 
computer. Speech reccgnitcn systems, while they generally do 
not affect the internal workings of the computer, present 
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their greatest potential advantage in increasing the 
efficiency of the total human/machine systerr. Industry was 
quick to recognize this potential: voice input systems are 
presently in use in various sorting and assembly-line 
applications . 



Computer 


input by voice presents 


several 


ad van tage 


s in 


the military context, 


especially 


i n 


the 


Command 


Fost 


environment . 


It frees 


operators' 


hands 


t 0 


enable 


o ther 



concurrent tasks, such as transcription or manipulation of 
other equipment, increasing productivity in both areas. [Ref. 
3] Just as importantly , it provides the potential for the 
voice-operator to maintain a graphic or figurative plot of a 
situation he may be monitoring at the terminal. This would 
allow others not familiar or comfortable with the computer 
to comprehend and follow what the operator may see unfolding 
at his work station, without requiring lengthy and 
distracting explanations from the operator. Voice-input 
could enable the operator to continue his task at the 
terminal and simultaneously manipulate a visual 
representation of the problem he is involved in, for others' 
benefit. This is a potential boon in the period of 
transition from a symbolic gestalt to an era cf much more 
widespread computer literacy. 

Moreover, cognitive psychology has presented a 
scientific model for task suitability to different 
modalities which takes the criteria for task assignment far 
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beyond the cDvious oasis cf ’ease". Sandry and Wickens [Ref. 
£: pp.8-10] have proposed the concept of " ideomotor 
compatabili ty” : human input/output rrodes rtay be rratched to 
the senses and hemispheres cf the brain which most readily 
process them. Quicker, more accurate responses result, when 
responses are matched to stimuli (such as hearing and 
speaking) . Short term memory for verbal information is 
significantly improved when that information is presented 
auditorily . 

There are obvious correlates of ideomotor comparability 
in a situation such as a Command Pest. The commander gives 
an operator verbal instructions regarding a task, and this 
operator then executes these with voice input to a terminal. 
In competing for the human operator's mental resources, it 
is Sandry and Wickens' thesis that no time-sharing decrement 
results when competing tasks are "ideomotor compatible". 

The automated resources available to the commander in 
the current environment are expanding and gaining 
increasingly widespread acceptance. The applicability cf 
voice input to computer systems is therefore both 
intuitively and logically attractive, and has been gaining 

increasing attention. Stress, however defined, is 

/ 

universally conceded to be a factor in the human side cf 
this equation, and therefore to has implications cf military 
interest in the command and control environment. 
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Given these ccns ideraticns , what then might re the 
effect of stress cn an operator of a voice input system? In 
various areas, research cn psychol cgical stress abounds, and 
researchers are now turning their attentions specifically to 
the effects of stress on the voice. The published research 
in this latter area is, in the main, inconclusive. It is the 
intent of this thesis to see if some relationship exists 
between stress incident cn a voice-input operator and his 
success rate with an automatic speech recognizer. It is to 
oe emphasized that virtually no wcrk has been published in 
this particular area. The current study proposes itself as a 
preliminary inquiry into a phenomenon of potential 
significance, and one which has as yet received little 
experimental attention. 
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II. V0IC2 RECOGNITION AND STRESS 



A. DEFINITION 

Central to any study of the interaction cf stress and 
the output of voice recognizers is a definition of what is 
to be understood cy "stress". As stated (cf. supra), the 
disagreement in defining stress is so fundamental that even 
recent treatments differ in classing stress as stimulus or 
response. In certain areas, however, consensus emerges. 

Stress m the phys ioicgicai sense is more clear-cut than 
the psychological. Physiologists may refer unamo iguously to 
human stressors such as heat, pressure, electric shock, ana 
the like, in tne way cf stimuli. The resultant reactions are 
also referred to as stress, ana are measured in cardio- 
pulmonary parameters, pupil dilation, end similar observecie 
and quantifiable phenomena. When speaking of physiological 
stress, it suifices to specify whether stimulus cr response 
is meant. N'any stressor- a gents have been extensively 
studied ooth in this country and abroad for their military 
impacts . 

The grey area is entered with psychological stress and 
its causes or manifestations. Various researchers define 
stress as the organism's reaction (coping or adaptive) tc an 
uniriendiy environment. Others define stress as the inimical 
influence of the environment on the individual. In recent 
usage, the former definition appears to have gained 
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ascendancy over the latter, although the debate is far from 
settled. 

It is therefore incumbent tc define psychoicgi cal 
"stress" before proceeding further. The definiton must be 
sufficiently broaa to span a wide gamut of potential 
phenomena, and thus preserve meaingfuiness . In addition, it 
must be sufficiently narrow to be useful and workable within 
the necessarily limited scope cf this experiment. A 
synthetic definition of stress will here mean "the arousal 
produced within the individual by unwelcome stimulus or 
threat". This is tie operational definition which will be 
adopted in an atterpt to examine tne end-effect of producing 
this type cf arousal in subjects interacting with an 
automatic speech recognizer. 



There is 


extensive 


literature on 


the subject 


c i' 


psychological 


stress 


(much 


of which 


falls within 


the 


definition above} and 


its 


correlates , 


especially 


the 



physiological correlates. The Navy- has done extensive worn 
in the field, most notably in San Diego. [Ref. 6] 

Psychological stress may be further oronen down into 
interesting subcategories. 1 ) Situational stress is 
generally held tc be the influence on the individual cf 
unfavorable environmental (out non-physical) factors. These 
factors are beyond the individual's control and are 

e enerelly thought to consist of a certain set of 

circumstances such as public speaking, deadlines, and the 
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iixe. c) Seif-induced stress is generally recognized as the 
self-imposition of a condition or stimulus leading to the 
type of arousal defined above. Examples include goals, 
deadlines, or performance requirements of any type with 
which the individual forces himself to function above a 
"ccirf crtacie" or ’’easy" level. 

These distinctions often merge, however. In a prime 
example, Swedish military pilots were given a relatively 
complex set of procedures to execute in an unsophisticated 
flight simulator, ann promised a reward for high 
performance. [Ref. ?] The situation was imposed on them, 
and could be construed as situational stress. The desire to 
perform at a high level, however, was self-induced. An 
interesting outcome of the experiment was that the 
physiological indicators of the pilots in question reacted 
remarKadly lihe those of pilots in a similar non- Simula ted 
situation. A further interpretation of these studies was 
that subjects had come to accept the reality of the 
simulated situations, and their physiological indicators 
reflected as much. Such studies, in general, tend to support 
the validity of simulated situations in conducting stress 
research . 

R. STRESS AhE TEE VOICE 

Respite the abundance of general stress literature, 
relatively little has Deen done on how this phenomenon might 
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manifest itself in the human voice. Hicks [Ref. 6] gives a 
thoughtful overview of the recent literature, in addition to 
his own experimental results with various forms of stress 
and voice. He concedes the generally accepted notion that 
stress has an influence on individuals' fundamental speaking 
frequency (lo); he concludes (as do others) that this 
parameter is as likely to go up as down, with concomitant 
frequency- range variations. The magnitude and direction of 
this shift in 3o is a function of the individual speaker. 
Additionally , tne amount of shift required to constitute an 
indication of stress is still a sutjective assessment. The 
one conclusive result, reported by liicks and others [Ref. 8: 
p.99, p.l£4j is that the ratio of speaking time to total 
time will increase in a stressed speaker. This is consistent 
with everyday experience: "stressed" speakers often appear 
to talk in longer bursts, with shorter pauses separating 
them. Parameters other than the speech-to-pause ratio give 
inconclusive or contested results. 

A large amount of commercial interest has focused on the 
influence of stress on vocal parameters. One can imagine the 
potential interest in being able to evaluate the stress 
level of a speaker. If done by voice, this analysis could be 
performed at great distances (vie telephone, radio, etc.) 
and without the speaker's knowledge. Several firms have 
marketed devices purported to analyze the stress level of 
speeders (as a sort of voice polygraph), but their claims 
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appear subject to debate and are hotly contested in academic 
circles. These devices base their analysis cn the existence 
of microtremor in the muscles controlling vocal activity, a 
phenomenon which rerains to oe shown conclusively. [Ref. 9: 
p.lV£] 

ihorever, the readout provided by voice stress analyzers 
requires rather subjective interpretation. As noted, vocal 
variations so far demons trated have shown a subject-specific 
nature: where one subject's 1c rises, another's may fall, 
etc. Thus, analysis of a speech sarpie for stress requires 
some apricri Knowledge of the individual speaker's 
tendencies. Analytic efforts so far have been limited by the 
necessity for rather subjective analysis. Work is currently 
underway both to oojectify such analysis and improve the 
analytical algorithms involved. *’ 

In sncrt, there currently no universal and few 
conclusive indicators of stress in a speaker's voice. It is 
widely accepted that psychological stress has an influence 
on vocal production, yet hotly contested in academic and 
industrial circles what the best Indication of such stress 
is. In a military/applications context, it may well be that 
tne most fruitful area of inquiry would be the implications 
cf stress upon the voice, from the viewpoint of productivity 
and reliability with autonatic speech recogoizers. 

^Conversations with Dr. D. Biers, University of Dayton, 
October 1962. 



III. EXPERIMENTAL COMPONENTS 



A. GENERAL 

It is generally recognized to De important to simulate 
m an experiment the conditions unaer which the phenomena of 
interest might actually be expected to occur. This is nc 
less important in experiments dealing with voice input, 
where there is a clearly definable task and one suspects an 
operative out unquantifiaole factor such as stress. 

Moreover, with voice input, it is essential to use subjects 
representative of those who might actually be using ASR in 
the task-envir cement of interest. 

E. SUBJECTS 

Twer, ty-f cur volunteer subjects were obtained, mainly 
from the 03 curriculum at the Naval Postgraduate school. The 
makeup of the sample is shown below: 

Taole 1 

SUBJECT DEMOGRAPHICS 
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TOTAL : 



Twenty-one or these subjects were miitary officers, in the 
grade of 03 and 04, representing the four services? three 
were from. civilian agencies. Six of the twenty-four were 
ferraie. These subjects were at a level in their careers 
where, especially in light of their C3 background, they 
might reasonably expect to be at the mil- tc upper levels cf 
a Command-Post staff. In short, they were prime candidates 
fcr using voice input in a Command-Fost scenario. 

Cf tne twenty-four, half haa seme prior experience with 
ASB, vnich was defined for the purposes cf the experiment as 
participation ic three or more experiments at the 
Postgraduate School? tne ethers had none. The sexes were 
evenly divided between the two groups. Batchellor iBef. 10] 
found no statistically significant difference in recognition 



ra tes 


between sexes with the 


particu lar 


recognizer being 


used. 


The 


balanced 


sample 


( bl ocked on 


sex) was used 


nonetheless 


to control 


for any 


unforeseen 


effects due tc 



genaer. 

C. VC C APULABY 

lor this experiment, subjects trained a fifty word 
vocabulary (Appendix A) which included some numerals and 
various other utterances. The vocabulary was chosen with a 
specific purpose in mind. It has teen shown [Ref.10] that 
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correct recognition cf a word or phrase is directly related 
to the length of the utterance. In this light, sorre words 
v/ere deliberately chosen over others to avoid confusion or 
possible rri sreccgn it ion . (For example ’’send message” in lieu 
of the shorter "send’.) Other words were emitted for the 
same reasons. Some of the vocabulary items were usea 
infrequently, tut were necessary for the task. In sum, the 
vocabulary chosen was the minimum felt necessary to enable 
composing short messages with a modicum of realism and some 
variety . 

L. TASK 

Each subject was given a scenario consisting of 2 V.'i 
utterances (Appendix B), with each word or phrase numbered. 
These utterances, when correctly interpreted cy the 
recognizer, brought up on the screen an output resembling 
messages which might be sent or serviced by a shipboard 
Command Post. (The ouput from these message sequences is 
shown in the right-hand column of Appendix B, which was not 
furnished to experiment participants; for examples of the 
types of messages see Figure 1.) Certain utterances produced 
a mul tipie-word output, simulating message-handling 
utilities such as are resident on the ARPANET, with which 
all subjects were familiar. Verisimilitude was an important 
consideration in the design of the task: 



SAMPLE MESSAGE OUTPUT 



SENE MSG TO:/ CV BATTLE GROUP / COMMANDER 
INPC COPT T'0: / COMTHIRDELEET / CINCPACFLEET 
FROM: / USS RATHBURNE 
POSITION / REPORT / NUMBER / 1 
REAEINESS LVL / 2 

POSSIBLE / ELECTRONIC / SURFACE / CONTACT 
BEARING: / 1/8/0 / DISTANCE / 2/7 
CONFIDENCE LVL/ 3 
REQUEST / INSTRUCTIONS 

QUIT./ 



FORWARD MSG ft: / 7 

INFO COPY TO: / CV BATTLE GROUP / COMMANDER 
FROM: / USS RATHBURNE 

QUIT ./ 



(NB: The symbol / indicates the separation 
between utterances. Line separation is 
accomplished by speaking "RETURN" which 
yields a carriage return.) 



Figure 1 



SAMPLE MESSAGE OUTPUT 
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The point of departure of tne synthetic-work approach is 
a behaviorai analysis cf the perfcrnrance requirements 
placed on the operator by some specific system, or by a 
class of such systems in general. Tasks are then 
selected against a criterion cf content validity (i.e., 
tasks ere selected Decause they measure functions judged 
by experts in the tieid to be important to the 
operational situation cf interest). A general criterion 
of face validity is also imposed (i.e., the tasks are 
configured tc be acceptable to target populations, e.g., 
pilots ... [Ref. 11: pp. 22-22] 



Subjects were to speak the utterances in order, each one 
until the proper output appeared on their screen. Each 
subject was given the same scenario three times in the 
course cf the experiment, with at least one day (but no more 
than two) between reprises. Cn subsequent trials, subjects 
were told that the scenario they were given was of exactly 
the same length and of similar content to the one(s) they 
haa seen previously. The same scenario was used repeatedly 
to control for variability oi the task, and it was felt that 
the scenario was of sufficient length and variation to 
negate any significant learning effect. 



E . TIME STRESS FACTOR 

During the first phase of the experiment (Phase 1), 
subjects were allowed to complete the scenario at their own 
pace, and were exhorted not to rush or needlessly linger, 
(cf. Appendix C). The experimenter attempted tc put them at 
ease. Unknow n to the subjects, they were being timed, ana 
their times to complete the scenario recorded. This time was 



24 



to serve as an individual oaseiine against v n lcb subsequent 
phases would be timed. In the next phases (Phases 2 and 2) 
subjects were allotted two-thirds and then one-third ci' 
their baseline times, respectively, tc attempt to complete 
the scenario. It was anticipated that not ail subjects 
would complete the scenario under the shortened time 
allowance: scoring was adjusted to reflect the amount of the 
task actually completed, (cf. IV. B infra) 

The time-compressior was intended to induce stress in 
tne subjects. They were iniormed at the outset of how much 
time they would have to complete a tasK with which they were 
already familiar. A large Gra-Lab darkroom timer was plainly 
visible in front of the subjects tc shew time remaining. 
Additionally, the experimenter reminded the subjects 
insistently at thirty-second intervals of their time 
remaining. Subjects could guage their own progress in the 

item scenario. Apriori, it was felt that the two-thiras 
time would constrain some dui not ail subjects; it was 
reasonably certain that allowing only one-third of the 
baseline time would do so. This opinion seemed to oe borne 
out in pilot trials (with subjects net used in the later 
experiment ) . 

i. EQUIPMENT ANE SETUP 

The voice recognition system employed was the T600 
recognizer manufactured by Threshold Technology, Inc. (See 

2i: 



ligure 2 for a dIock diagram of tne system.) Ibis is a 
discrete utterance analyzer, wnich analyzes samples of 
speech up to a maximum of two seconds in length, separated 
by a distinct pause of at least one-tenth of a second. 
Utterances of more than one word are allowed, as long as tne 
words are run together ana pronounced "naturally", without 
distinct creaks between them. 

The 16016 has a maximum capacity cf 256 utterances. In 
the training mode, the subject repeats a word or phrase ten 
times. (Under certain circumstances, fewer repetitions nay 
oe used, tut this requires modification of the software and 
yields less consistent results [Ref. 10]). After the tenth 
repetition, the ten are superimposed and normalized in 
length to form a template for that utterance. Turing this 
experiment, a training standardization measure was adopted. 
When the subjects had finished training, they repeated the 
vocabulary list in toto at least twice,* any items not 
correctly recognized on at least two of three passes were 
retrained . 

When the user speaks, his speech sample is compared 
against aii these templates for the best match. If within 
preset tolerances, the utterance is recognized (correctly or 
not) and the output string sent to the display screen. If nc 
natch is found, the machine produces an audible "beep". Tach 
individual may store his voice template on a data-tape 
cartridge for future use, and thus bypass the lengthy 
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training process in future sessions. Each utterance is 
programmed by the user (in this case, the experimenter) with 
a prompt for training. When that utterance is cued at the 
Keyboard, the prompt-string appears on the display,* it 
disappears after the tenth repetition. After training, the 
recognizer shifts to the recognixon mode and awaits verbal 
input. When utterances are recognized, an associated 
preprogrammed output string is sent to the display screen. 
The output string corresponding to an utterance is user- 
selected, allowing up tc a maximum of sixteen alphanumeric 
characters. 

When used in conjunction with a computer, the T 6GZ may 
be used in either direct or buffered modes. "Eirect" sends 
the output string to the computer without delay. The 
"Suffered” mode allows the user tc verify the output before 
allowing it to ce sent. The direct mode was useu here. In 
this experiment, the T600 was used in a stand-alcne 
capacity: output strings were sent to the display screen and 
nowhere else, (for further discussion see [Ref. 1 2 j ) 

The microphone used was a Shure S h'' 10 noise cancelling 
unit. It was worn oy all subjects on the left side of the 
head, directly below and slightly to the left of center of 
the lips. Tc further attenuate echo and outside noise, the 
experiment was conducted inside an Industrial Acoustics 
Company soundproof chamber. (See figure 3 for the actual 
equipmen t setup ) . 
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IV. EXPERIMENTAL EES KIN 



A. OBJECTIVE 

The primary objective was to see if time stress affected 
users' recognition rates with this voice recognition setup. 
After the initial training session, (and after a delay of 
three to four days) subjects began the portion cf the 
experiment which involved the scenario. They were fitted 
with tne microphone and handec the scenario. For each 
respective phase, they were read the instructions in 
Appendices C,D, and E. The intention was to induce stress in 
subjects in the iast two phases cf the experiment by 
progressively shortening the tire allowed to perform a task 
of fixed length. Compression cf time allowed was to be 
correlated with percent correct recognition rate. 

It was hoped that several factors were to be at work on 
the participants. There was a definite competition for the 
subjects' mental resources. Subjects baa to read a word or 
phrase from their printed scenarios, speak it, and verify 
tnat it appeared correctly on their screen. If misrecogni zed 
cr "beeped", they were to try again until correctly 
recognized. The experimenter instructed subjects to proceed 
to the next scenario item if they had five unsuccessful 
attempts, although they haa no foreknowledge of this. This 
was yet another factor in the stress equation: failure at a 
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tasv is in itself stressful for most indi vidua Is . [Ref . 13: 

p . 151] 



At the cutset cf each of the last two (time-constrained) 

phases of the experiment , subjects were informed of how much 

time they would ne allotted to perform the scenario. After 

the second and before the last phase,, many indicated to the 

experimenter that they "vnew" they wet, Id have less time than 

in the previous session. This suspicion was desired and was 

calculated to create a measure cf negative anticipation in 

the participants. During the last two phases of the 

experiment, subjects were reminded insistently by the 

experimenter of time remaining, in addition to the presence 

of the highly visible timer. It was estimated that this 

combination of factors would induce stress: 

The apprehension of psychological stressors is a much 
more complex business. It depends on: (l) prior 

experience with a class of stressersj (2) remembering 
tne experience; (3) recognizing that the present 
stimulus gestalt is an instance cf the earlier class of 

stressors; and ' v 4 ) believing that the livelihood of the 

threatened occurrence is above some subjective 

thresbhold. [Ref. 13: p. 142] 



f.oreover , 

While the experimental manipulation allows a fairly nigh 
degree cf control over the stimulus conditions, the 
reaction patterns of subjects are often difficult to 
determine. ... Thus, the stress level induced may be 
minimal for some subjects, whereas it may be moderate or 
rather strong for others. Since it is often difficult to 
determine a definite eiternal criterion for stress (even 
psychophys i olcgical variables cannot always be expected 
to indicate the stress level of an individual 
consistently ana validly,) exper in enters using 
laboratory stress induction can only hope that they have 
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been able tc induce a reasonable amount of stress in 
their subjects. iHef. 9: p. 1?6J 

The fundamental hypothesis being tested here may be 
sumiTea up as: 

He: Time stress has no effect on the recognition 
rates of users of voice recognition systems. 

HI: Time stress affects the recognition rates of 
users of voice recognition systems. 

Andi ti cnel ly , it vas hoped to see whether: 

He: Experienced, and inexperienced users of voice recognition 
systems are affected equally by time stress. 

HI: Experienced and inexperienced users of voice recognition 
systems are cot affected equally by time stress. 



ti. SCORING 

Subjects were monitored during their performance of the 
scenario: the experimenter sat to the right of and behind 
subjects (cf. Figure 3) from which position both the 
subjects' actions and the display screen were clearly 
visible, f'isreccgnit ions (improper word substitutions by the 
recognizer) and non-recognitions were recorded. A confusion 
matrix of substitutions and "beeps’ is included as Appendix 



i . Subjects occasionally lost their place in the scenario, 
repeating some vocabulary items they had already spoken. 
These repetitions were counted as additional utterances, and 
the correct or incorrect result recorded? thus, no penalty 
ves given for repetition. The caveat in the instructions 
about penalties for non-completion of the scenario was 
ccgus. It was added to provide ar. additional incentive tc 
finish, and in tne hope of reinforcing the subjects' 
apprehension. (Subjects completed an average of fifty-three 
percent of tne scenario in Fhase 3? none finished.) 
Recognition rates were based on the items of the scenario 
aciually completed. Percentage correct recognition was 
figured as the quotient of the number of correct 
recognitions divided oy the total number of utterances 
spoaen by the subjects (including mis- and non- 
recognitions ) . 

At the end of each phase of the experiment, subjects 
were asked to rate their feelings during that phase. (See 
questionnaire, Appendix G). Five surrogate descriptors were 
used to circumscribe the idea of "stressed"; subjects were 
asKed if they f e It : 



1. nervous 

2. confused 






pressured 



4. irritated 



5. anxious 

on a scale of one to five, five being the highest level of 
each. It was thought that these individual response levels 
might somehow te related to recognition rates. 

C. CONCEPTUAL EES IGN CE THE EXPERIMENT 

The design employed was a two-factor mixed design with 
repeated measures on one factor. [Ref. 14: pp. 54-61] 
Alternatively (and for purposes or clarity) the design might 
be thought of as involving two conditions 
( exper len cea/ i nexper ienced ) and three treatments. (See 
iigure 4 for a graphic interpretation). 

As stated previously, the treatments consisted of three 
variations of time in the testing, constituting the three 
phases (excluding the training phase). 



1. 


Fhase 
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baseline time 


: nc constraint 
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t ime 



These phases were conducted in the order shown. While it 
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Figure 4 



CONCEPTUAL DESIGN OF THE EXPERIMENT 



might be thought preferable in the classical design of 
experiments to randomize the administration of the time 
constrained portions, this was not done. Randomization 
might have controlled for the possible effects of "learning" 
between Fbases 2 and 3j this benefit was consciously 
sacrificed in order to introduce the apprehension factor 
discussed above. It was suspected apriori that the drastic 
time compression from the second to the third phase of the 
experiment would help to compensate for the possible 
confounding introduced by "learning". Moreover, the scenario 
was felt to be long and varied enough to counteract learning 
in some measure, in addition to the experimenter's deception 
that successive scenarios were not exactly the same. The 
fact that all phases were separated by no less than a day 
• v aaa no mere than two) was also felt to counteract learning. 
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V. RESULTS AND ANALYSIS 



A. ANALYSIS 

The results of the experiment as described are shown 
graphically in Figure t . Before conducting any analysis, 
Hartley's test- for equality of variance was performed on the 
raw data. The results indicated that equality of variance 
was an invalid assumption, and thus the raw data required 
transformation: after arcsln transformation, the equality of 
variances was accepted. (See Eigure 6) 

The analysis of variance table is presented in Eigure 7. 
As is readily apparent from the graph of the raw data, 
recognition rates for the experienced group decrease 
monotcnically with time compress i cn . This is also true for 
Phases 2: and 3 of the inexperienced group. The E statistic 
shows a significant difference between trials. Therefore, 
the null hypothesis of time stress not affecting recognition 
rate is rejected. 

An interesting phenomenon is observed with the 
inexperienced group, however. Erom Fhase 1 to Phase Z their 
success rate increases noticeably, despite the decreased 
time allotted for the last. This is hypothesized to be the 
result of a combination of factors, the most obvious of 
which is learning. From their first, open-ended trial to 
the second, the inexperienced group became more adept at the 
tasit. Moreover, given their relative naivete with the 
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SUMMARY OF EXPERIMENTAL RESULTS 



RAW LATA 

(For percentages, multiply by 100) 



X Sx 





Phase 


1 


.959 


.0033 


EXPERIENCEE 


Phase 


ri 

a 


.y47 


.0012 




Phase 


3 


.897 


.0041 




Phase 


1 


.ye? 


.0081 


INEXPERIENCED 


Phase 


2 


.941 


.0023 




Phase 


3 


.910 


.0037 



For afl=t=6 and df 2= ( n-1 ) =11 , 

Hartley's test, Fmax = 6.32 (aipha=.05). 
lor the untransf crmed data: 

Smax/Smin = .0061/. 0012 = 6.76 
Therefore, reject equality cf variances; transform data. 
After the transformation (y = 2(arcsin\fir )): 

Smax/Smin = .04=28/. 0121 = 3.537 
Accept equality of variances. 

Figure 6 

LATA SUMMARY AND HARTLEY'S TEST 
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.0642 


.702 
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equipment setup ana the task, ineiperiencea subjects took 
longer to complete the initial phase of the experiment and 
thus had a longer baseline (an average of 7.6b minutes, 
versus 6.46 for the experienced). In the linear compression 
cf Phases 2 and 3, they simply had more time than the 
experienced group. 

It was not kncwn apriori if allowing two-thirds of 
baseline time in the second phase would impose a felt time- 
constraint on ail subjects. lor this reason, one-third was 
chosen for the final phase: although seemingly impossible, 
it was felt that such a drastic time reduction woild induce 
stress in the majority cf the subjects. Such appears to be 
the case. Experienced subjects show a decline in each 
successive phase cf the experiment. Inexperienced subjects, 
although theoretically still on the upward side of their 
'learning curve” show a pronounced decline from Phase 2 to 
Fhase 2. 

Per the inexperienced group, both the rapidity cf the 
learning effect ana the quickness with which it was negated 
have additional significance. A Newmao-Keuis range test 
'.alpha = .Zb) was performed for differences in the means 
amongst phases of the experiment. l?.ef. 16: pp. 35-27] 
Phases 1 ana 2 were seen to oe signif icently different from 
Phase 3, cut were not differentiable between themselves: 
this is obviously due to the inexperienced group starting at 
a lower rate, then coming up to meet the experienced group's 
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mean score. A iwo-sampie "t"-test shows a difference Between 
the experienced ana inexperienced groups only in the first 
phase. (At an alpha critical of .269). In subsequent phases 
of the experiment, the two groups are statistically 
indistinguishable. This is further confirmed by the F 
statistic for experience in the analysis of variance. The 
inference to be drawn from this appears to be that the 
effects of learning cn this type of equipment are so rapid 
as to meiie the two groups quichiy very sirrilar. 

B. CORRELATION 

first, an attempt was made to correlate subjects' 
questionnaire responses with tne phase of the experiment tc 
which they were responding. It was desired to see if 
response levels were somehow dependent on the time stress 
levels imposed on the participants. If sc, a positive 
correlation would show a rising response level to one or 
more of the five questions as time compression increased 
with experiment phase. The data to be correlated were 
nominal (phase) versus ordinal (1 to 5 cn questionnaires) so 
tne ncnparame trie Spearman's Rho was used. [Ref. 17: pp. 
252-256] Table 2 shows the results: 
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Taole 2 



Correlation of Questions with Phase 



QUESTION EHO 



1. nervous .224 * 

2. confused .017 

3. pressured .522 * 

4. irritated .020 

5. anxious .220 * 



(* indicates significant at alpha less than .05) 

Thus, three of the five questions shew a strong correlation 
with the time compression with phase. Moreover, these tnree 
particular descriptors (nervous, pressured, and anxious) 
were thought to he the closest surrogates of the five to 
otherwise Jescribe the situational or time stress desired. 
(The other two show no correlation.) It appears that the 
experimental conditions were successful in inducing stress 
m sons measure. Mean response rates for subjects' answers 
are shewn in figures £-12. 

Next, an attempt was made to correlate subjects' 
questionnaire responses (on the five descriptors already 
mentioned) to their recognition rates with the system. It 
was suspected beforehand that response levels tc one or more 
of these questions might increase monotonicaiiy from one 



3.0 



EXPERIENCED 

INEXPERIENCED 




figure S 

MEAN RESPONSE LEVELS TC QUESTION 1, "NERVOUS 






o.*J - 



'< L.A - 



■DC PZRIZNC. 



— — i Myi P ZK 1 1 ivi C -i I) 



l p 

X • w 



1 .0 



e.b 



z • ^ 





i 

i 



Phase 1 



Phase P 



Phase C 



iii^'ure 9 

Ah Hi S i C f : 5 i LEVELS 10 QbZSIICL P, CCNEl. SEE 



3.0 




0.0 



Phase 1 Phase 2 



Phase 3 



iigvre 10 

MEAN RESFCNSE LEVELS TC QUESTION 3, "PRESSURED 



46 



3.0 - 

i 

| EXPERIENCE! 

i 

! INEXPERIENCED 




1.0 - 



0.5 - 



0.0 s ! ! 

Phase 1 Phase 2 Phase 3 



iigure 11 

MEAN RESPONSE LEVELS TO QUESTION 4, "IRRITATED 



47 



3.0 



EXPERIENCE! 

INEXPERIENCED 




Hgure 12 

MEAN RESPONSE LEVELS TO QUESTION 5, "ANXIOUS 



48 



phase to the next during the conduct cf the experiment. It 
is readily apparent that this was not the case. While the 
five surrogate descriptors were deemed capable, in the 
aggregate, tc describe stress, they apparently were not 
completely successful as a subjective measure. 

The ris<£ of self-inhibition is always run when asking 
subjects tc rate their own perceptions, emotions, etc. [Ref . 
18: pp . b01-502] Self-image or self-esteem may prohibit a 
respondent from admitting of a higher level cf what he may 
feel to ce an "undesirable" feeling cr trait. This may have 
been the case here. In the course of the experiment, the 
experimenter's subjective assessment of the subjects' 
emotional states did not agree well with their questionnaire 
responses. Cn several occasions, subjects left the 
experiment giving every appearance of being agitated and 
exercised, having answered with a "l" (i.e. not at all) to 
ail five questions . 

Moreover, although instructed to respond only in regard 
to each individual phase of the experiment, it appears 
lihely that subjects' responses may have been in the context 
cf their previous experiences in the experiment. Thus one 
sees the rise in most responses from the first (untimed) to 
the second phase of the experiment. Curing the final phase, 
subjects were expecting to be placed under a tighter time 
constraint (the desired apprehension effect). This may in 
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part explain the absence of a rise in response levels for 
this last phase. 

The data gathered from the questionnaires was in the 
ordinal (l to 5) scale. Since an attempt was to be made to 
correlate these responses with recognition rates (interval 
aata) recourse was again made tc the non-parametri c 
Spearman's Rho procedure for correlating the ranks of both 
sets of data. Recognition rates were tested against 
responses to all five questions for each phase of the 
experiment. Results generally showed no correlation. 

One questicn alone provided a rather consistent negative 
correlation with recognition rates. For the inexperienced 
subjects, question 2 ("confused") showed a strong negative 
correlation (rho< -0.4) for all three phases of the 
experiment (credible at an alpha less than or equal tc 0.1). 
This would imply that as confusion level rose, recognition 
rate went down. It is interesting tc note that there was nc 
correlation found between this variable and recognition for 
the experienced group. The only other question which showed 
some (negative) correlation was the fourth ("irritated"), 
but this relation was at most tenuous ( 0 .25>a lpha>0 . 1 ) . Also 
of note is the fact that, after the initial phase of the 
experiment, response levels for the two groups parallel one 
another, in some instances very closely. This would appear 
further to corroborate the hypothesis that differences 
oetveen the two groups diminish rapidly. 
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VI. REMARKS 



If psychological stress has an effect on the voice, as 
is generally acknowledged, it is reasonable to expect it to 
have an effect on the success rates of users of voice input 
equipment. As discussed previously, ASR technology is of 
potentially great interest to the military planner in the 
Comrand, Control, and Communications context. This 
preliminary inquiry has attempted to shew a correlation 
between stress and recognition success with such equipnent. 
Several areas of consideration suggest themselves. 

As has been seen, recogniton rates declined when the 
operators of this ASR equipment were placed under tine 
stress. An alternative approach to evaluating the 
desirability of this technology might be to assess voice 
versus other means of input under similar conditions. In 
this study, subjects attempting to complete a nearxy 
impossible task (Phase 3) nonetheless managed to maintain a 
correct recognition rate cf approximately ninety percent. 
With manual input (e.g., typing), each characer to be input 
represents an opportunity for error: how this might be 
effected ty psychological stress is open to speculation, 
jvhen one considers that a sixteen character output string 
can be produced with one voice command, it may well be that 
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voice input becomes even more desirable ia a stressful 
environment . 

It is interesting to note bow quickly tbe inexperienced 
subjects "caught up" with and paralleled tbe performance of 
their experienced counterparts. If this is indeed a 
generalizable phenomenon, it would inply that after some few 
training sessions with a recognizer, the distinction 
vanishes. If so, faced with a potentially adverse situation 
a commander or watch officer need not worry about this 
experience-level in his Command Post staffing. Voice input 
has also been proposed for automated reservation and 
directory-assistance schemes. Given the success rates for 
inexperienced users even under conditions calculated to 
induce stress, these applications appear no less feasible . 

Lastly, it is generally acknowledged that a more 
objective method for assessing psychclcgica 1 stress is 
desperately needed. Any further work in this area should 
find an alternative and hopefully more workable method of 
assessing stress in subjects. It is submitted that some 
relatively non-intrusive physiol ogi ca 1 measures of stress be 
considered. Several of these observable and quantifiable 
indicators are well documented in existing stress 



literature. 



APPENDIX A 



* V :* # # * * * * sjc jjc * # * sje * * 



^VOCABULARY LIST 3 " 

# V >f 3f * * # V *f X 5fc Jfe * # 3f 3f # 



ft WORD # 



0. ZERO 


25 


1. ONE 


26 


2. TWO 


27 


2. THREE 


28 


4. FOUR 


29 


5. FIVE 


20 


6. SIX 


21 


7. SEVEN 


32 


8. EIGHT 


23 


9. NEGATIVE 


24 


10. TERMINATE 


35 


11. SEND MESSAGI 


36 


12. ANSWER MESSAGE 


37 


12. FORWARD MESSAGE 


28 


14. C I NCPACFLEET 


29 


15. THIRD FLEET 


40 


16. BATTLE GROUP 


41 


17. INFORMATION 


42 


18. RETURN 


43 


19. RADAR 


44 


20. VISUAL 


45 


21. ELECTRONIC 


46 


22. CONTACT 


47 


2c. SIGHT INC- 


48 


24. SOVIET 


49 



WORD 

UNKNOWN 

POSSIBLE 

CERTAIN 

CONFIDENCE 

DAMAGE 

ASSESSMENT 

REQUEST 

INSTRUCTIONS 

READINESS 

INTENT 

ATTACK 

REPORT 

RATHBURNE 

FROM 

COMMANDER 

SURFACE 

TIME 

ZULU 

PERIOD 

POSITION 

NUMBER 

BEARING 

DISTANCE 

UNDER 

ADVISE 
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w *s # jgc J(t * : Jjc * W * sp >f JP V 5p 

^SCENARIO LISTING* 



CRT OUTPUT 



1 . 


SEND MESSAGE 




c • 


BATTLE GROUP 




3. 


COMMANDER 




4. 


RETURN 




u 

*— • 


INFORMATION 




6. 


TEIREELEET 




?. 


CINCPACFLEET 




8 . 


RETURN 




9. 


FROM 




10. 


RATBBURNE 


SEND MSG TO: CV BATTLE GROUP COMMANDER 
INFO COPY TO: COMTHIRDFLEET CINCPACFLEET 


11 - 


RETURN 


FROM: USS RATHBUHNE 
POSITION REPORT NUMBER 1 


12. 


PCS I TON 


READINESS LVL 3 

POSSIBLE ELECTRONIC SURFACE CONTACT 


13. 


REPORT 


BEARING : 180 DISTANCE 27 
CONFIDENCE LVL 3 


14. 


NUMBER 


REQUEST INSTRUCTIONS 


15. 


ONE 


QUIT. 


ie. 


RETURN 




17. 


READINESS 




18. 


THREE 




19. 


RETURN 




20 . 


POSSIBLE 





21. ELECTRONIC 



SURFACE 



22 . 

23. CONTACT 

24. RETURN 

25. BEARING 

26. ONE 

27. EIGHT 
26. ZERO 

2y. DISTANCE 

30. TWO 

31. SEVEN 

32. RETURN 

33. CONFIDENCE 

34. THREE 

35. RETURN 

36. REQUEST 

37. INSTRUCTIONS 

38. TERMINATE 



39. FORWARD MESSAGE 

40. SEVEN 

41. RETURN 



42. INFORMATION 

43. BATTLE GROUP 

44. COMMANDER 

45. RETURN 



FORWARD MSG #:7 

INFO COPT TO: CV BATTLE GROUP COMMANDER 
FROM: USS RA1BBURNE 

QUIT. 



CR 



46. *ROM 



47. RATHBURNE 

48. TERMINATE 

49. ANSWER MESSAGE 

60. TWO 

51. FOUR 
62. RETURN 

ANSWER MSG #: 24 

53. CONTACT CONTACT UNKNOWN POSSIBLE SOVIET. 

(no carriage return in scenario) 

54. UNKNOWN INTENT UNKNOWN 

55. POSSIBLE QUIT. 

56. SOVIET 

57. PEE ICE 
5e. INTENT 

59. UNKNOWN 

60. TERMINATE 

61. SENE MESSAGE 

62. BATTLE GROUP 

63. COMMANDER 

64. RETURN 

65. INFORMATION 

66. THRIEELEET 

67. C IN CPACE LEET 

68. RETURN 
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69. CONTACT 



70. SIGHTING 

71. REPORT 

72. NUMBER 

73. SIX 

74. RETURN 
7£. TIME 
76. ONE 



77. SEVEN 

78. FOUR 

79. EIGHT 

80. ZULU 



SEND MSG TO: CV EATTLE GROUP COMMANDER 
INFO COPY TO: CCMTBIRDFLEET C INCPACFLEET 
CONTACT SIGHTING REPORT NUMBER 6 
TIME 1748 ZULU 
POSITION 16720 

COMMANDER ASSESSMENT POSSIBLE SOVIET SURFACE, 
(no carriage return in scenario) 

UNKNOWN 



81. RETURN 

82. POSITION 



QUIT. 



83. ONE 

84. FIVE 

65. SEVEN 

66. TWO 

67. ZERO 

68. RETURN 



69. COMMANDER 



90. ASSESSMENT 

91. POSSIILZ 

92. SOVIET 

93. SUREACE 
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y4. PERIOD 



95. UNKNOWN 

96. TERMINATE 

97. ANSWER MESSAGE 

98. THREE 

99. EIGHT 

100. RETURN 

101. INFORMATION 

102. C INCFACFIEET 

103. RETURN 

104. FROM 

105. RATB5URNE 

106. RETURN 

107. UNKNOWN 
106. SURFACE 

109. CONTACT 

110. PERIOD 

111. POSSIBLE 

112 . SOVIET 
112 . RETURN 

114. UNKNOWN 

115. RADAR 

116. CONTACT 

117. BEARING 
116. TWO 



ANSWER MSG ft: 26 

INFO COPY TO: CINCPACFLEET 

FROM: USS RATH BUR ME 

UNKNOWN SURFACE CONTACT. POSSIBLE SOVIET 
UNKNOWN RADAR CONTACT BEARING: 235 
DISTANCE 14 

NEGATIVE VISUAL CONTACT. 

CONFIDENCE LVL ASSESSMENT 6. 

INTENT UNKNOWN . REQUEST ADVISE 

QUIT. 
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119. 


THREE 


12 e. 


FIVE 


121. 


RETURN 


122. 


DISTANCE 


123. 


ONE 


124. 


FOUR 


12£ . 


RETURN 


126. 


NEGATIVE 


12?. 


VISUAL 


128 . 


CONTACT 


129. 


PERIOD 


130 . 


RETURN 


131 . 


CONFIDENCE 


132. 


ASSESSMENT 


133 . 


SIX 


134. 


PERICD 


13£ . 


RETURN 


136. 


INTENT 


13?. 


UNKNOWN 


136. 


PERIOD 


139 . 


REQUEST 


140. 


ADVISE 


141 . 


TERMINATE 


142 . 


SENE MESSAGE 



£9 



143. BATTLE GROUP 

144. COMMANDER 

145. RETURN 

146. INFORMATION 

147. THIRL! LEET 
146 . RETURN 

149. FROM 

150. RATHBURNE 

151. RETURN 

152. CONTACT 

153. REPORT 

154. NUMBER 

155. SIX 

156. RETURN 

157. CONTACT 
156. SIGHTING 

159. RETURN 

160. CONTACT 

161. CERTAIN 

162. SOVIET 

163. SURFACE 

164. RETURN 

165. BEARING 

166. TWO 

167. THREE 



SEND MSG TO: CV BATTLE GROUP COMMANDER 

INFO COPY TO: COMT'H IRDF LEET 

FROM: USS RATHBURNE 

CONTACT REFCRT NUMBER 6 

CONTACT SIGHTING 

CONTACT CERTAIN SOVIET SURFACE 

BEARING: 237 

DISTANCE 14 

INTENT UNKNOWN 

QUIT. 



SEVEN 



168 . 

16b. RETURN 

170. DISTANCE 

171. ONE 
173c . FOUR 

173. RETURN 

174. INTENT 
173. UNKNOWN 

176. TERMINATE 

177. SENE MESSAGE 

SEND MSG TC: CCNTHIRDFLEET 
INFO COPT TC: CINCPACFLEET 
FROM: USS RATHBURNE 

COMMANDER ASSESSMENT CV BATTLE GROUP 
(no carriage return in scenario) 

UNDER SOVI2T ATTACK. DAMAGE LVL 
(no carriage return in scenario) 
UNKNOWN. REQUEST ADVISE USS RATHBURNE 
(no carriage return in scenario) 
INTENT 

QUIT. 

183. RETURN 

186. COMMANDER 

187. ASSESSMENT 
186. BATTLE GROUP 
ley. UNDER 

19 C. SOVIET 
191. ATTACK 



176. TEIREFLEET 

179. RETURN 

180 . INFORMATION 

181. C IN CFACFLEET 
188. RETURN 

163. FROM 
184. RATHBURNE 
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PERIOD 



192. 

192 . DAMAGE 

194. UNKNOWN 

195. PERIOD 

196. REQUEST 

197. ADVISE 
196. RATHPUHNE 
199. INTENT 
2ZZ. TERMINATE 



END SCENARIO 

s* * * Sf. jp *c v sje # *s 5* # s* J(c sjt* * V V 
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AFPENEIX C 



INSTRUCTIONS TC EXPERIMENT PARTICIPANTS -PHASE 1* 



The experiment you will be par ticipat ing in simulates 



wha t 


might happen in a 


ship board 


command post. 


You 


will 


be 


using 


the vocabulary you 


have 


already trained 


during 


the 


first 


session. 














You will be given a 


list 


of 


words to speak 


to 


the 



machine: when recognized, they will come up on your screen. 
Certain words produce a multiple word output, as you have 
already seen. These are an attempt tc simulate message- 
handling utilities such as are found on the ARPANET. 

Speak clearly and distinctly, tut don't overenunciate. 
No provision has been made to let yen back up and correct 
mistakes, mi srec cgni t ions , etc., so ; ou rust continue to say 
the word until it is recognized. If you miss a word and 
don't catch it, I will prompt you for the word you missed? 
please simply try again on the word I prompt you with. 
Pauses between words may be short, tut they must be 
distinct. 

Set your own pace, don't rush but don't linger. You are 
not competing against anyone (including yourself) for time 
or recognition, so don't be nervous. Mo grades are being 
given out here. Once you start, however, please continue to 
the end . 

I will be glad to answer any questions you may have 
about the conduct of this phase of the experiment. Any 
questions about the purpose and outcome I will be glad tc 
discuss at great length once the actual experimentation 
phase is through. 

Thanks again for ycur help. 
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APPINEIX E 



INSTRUCTIONS TO EXPERIMENT PARTICIPANTS ’"PEASE 2* 



This is Phase 2 of the experiment. In this phase you 
will participate in a Command Pest scenario very similar in 
content and length to the first scenario you were given. 

Tne most significant difference in this phase is the 
time factor. In Phase 2 you will be allotted only 2/3 of the 
time you originally took to complete the entire scenario. In 
tact, you may not be able to complete the entire scenario. 
It is to ce emphasized that your primary objective is tc 
complete as much of the scenario as you possibly can, as 
accurately as possible. In this command post situation, the 
messages you will be handling are cf an urgent nature, and 
your primary motivation is to get as many of them completed 
as possible. You are being scored fer both recognition rate 
and the percentage of the scenario you complete. Any parts 
you ac not cor- plete will count against your overall score, 
unfortunately .... 

During the experiment, I will give you frequent 
reminders of the time you nave remaining at 30 second 
intervals. The time I announce will be in minutes and 
seconds remaining. The timer will alsc furnish ycu with a 
running indication of time remaining. 

Again, attempt to speak clearly and distinctly. No 
provision has been made to back up and correct mistakes cr 
misrecogni ti ens , sc you must repeat the word or phrase until 
it is correctly recognized. If you miss a word and don't 
catch it, I will prompt you for the word ycu missed: please 
try again on tne word I prompt you with. 

Let me re-emphasize here that the shortened tirr.e- 
aiicwance is meant to represent the urgency of the situation 
in the Command Post, and that your principal goal is to 
finish as much of the scenario as possible. 

Thanks again for your help. 
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APPENDIX E 



INSTRUCTIONS TC EXPERIMENT PARTICIPANT'S ^PHASE 3* 



This is Phase 3 of the experiment . In this phase ycu 
will participate in a Command Post scenario very sirilar in 
content and length tc the first scenario yon were given. 

The rrost significant difference in this phase is the 
time factor. In Phase 3 yon will be allotted only 1/3 of the 
tire yon originally took tc complete the entire scenario. In 
fact, yon may net be able to complete The entire scenario. 
It is to he emphasized that ycur primary objective is to 
complete as much of the scenario as yen possibly can, as 
accurately as possible. In this command pest situation, the 
passages you will be handling are cf an urgent nature, and 
ycur primary motivation is to get as many cf the™ completed 
as possible. You are being scored for both recognition rate 
and the percentage cf the scenario you complete. Any parts 
ycu dc net ccm- plete will count against ycur overall score, 
unfortunately .... 

luring the experiment, I will give you frequent 
reminders cf the time you have remaining at 3? second 
intervals. The time I announce will be in minutes and 
seconds remaining. The timer will also furnish you with a 
running indication of time remaining. 

Again, attempt tc speak clearly and distinctly. No 
provision has been made to back up and correct mis take s or 
misreccgciti ens , sc you must repeat the word cr phrase until 
it is correctly recognized. If you miss a word and don't 
catch it, I will prompt ycu for the word you missed: please 
try again on the word I prompt ycu with. 

Let me re-emphasize here that the shortened time- 
allowance is meant tc represent the urgency of the situation 
in the Ccmmard Pest, and that ycur principal goal is tc 
finish as much of the scenario as possible. 

Thanks again for your help. 
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APPENDIX G 



QUESTIONNAIRE 

3? WW >}t ^ 3e;£3£ jgcspxc sjc:(e:(c:Cc 5?# W W W¥ W W S(!JQc W # W VW :(: » :$£ s? s}s JP V >> V 

SUBJECT NUMBER 



DATE- 



PHASE 





Plea 


se answ 


er the following qu 


es t ions 


concerning 


your 


feel 


ings 


during 


the phase of the 


exreri 


ment you 


have 


just 


corrp 


leted 


. These 


questions pertain 


ONLY to 


this phase. 






Circ 


le the 


response which best 


descri 


bes your 


feel 1 


Lngs . 


The 


scale 


is: 













1 = NOT AT ALL 
3 = M0DERAT3IY OR SOMEVEAT 
5 = VERY MUCH SC 



Responses 2 and 4 are 



the midpoints between the above. 



QUESTION: (Circle one for each question) 

During this phase of the experiment, I felt: 



not at all rrcderateiy 



1 . 


nervous 


1 


2 


3 


4 


2. 


confused 


1 


2 


3 


4 


T. 

o • 


pressured 


1 


2 


r < 


4 


4. 


irritated 


1 


2 


•7 

o 


4 


C, 

w t 


anxious 


1 


r* 

c 


3 


4 



very much sc 



p 

t. 



5 

5 



s^jpjcpLE^sE ! Don't discuss your experience or answers with anyone. 
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